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Abstract — Flash memory is well-known for its inherent asym- 
metry: the flash-cell charge levels are easy to increase but are 
hard to decrease. In a general rewriting model, the stored data 
changes its value with certain patterns. The patterns of data 
updates are determined by the data structure and the application, 
and are independent of the constraints imposed by the storage 
medium. Thus, an appropriate coding scheme is needed so that 
the data changes can be updated and stored efficiently under the 
storage-medium's constraints. 

In this paper, we define the general rewriting problem using 
a graph model. It extends many known rewriting models such 
as floating codes, WOM codes, buffer codes, etc. We present a 
new rewriting scheme for flash memories, called the trajectory 
code, for rewriting the stored data as many times as possible 
without block erasures. We prove that the trajectory code is 
asymptotically optimal in a wide range of scenarios. 

We also present randomized rewriting codes optimized for 
expected performance (given arbitrary rewriting sequences). Our 
rewriting codes are shown to be asymptotically optimal. 

Index Terms — flash memory, asymmetric memory, rewriting, 
write-once memory, floating codes, buffer codes 



I. Introduction 

MANY storage media have constraints on their state 
transitions. A typical example is flash memory, the 
most widely-used type of non-volatile electronic memory [31. 
A flash memory consists of floating-gate cells, where a cell 
uses the charge it stores to represent data. The amount of 
charge stored in a cell can be quantized into q ^ 2 discrete 
values in order to represent up to log2 q bits. (The cell is called 
a single-level cell (SLC) if cj = 2, and called a multi-level cell 
(MLC) if q > 2). We call the q states of a cell its levels: level 
0, level 1, . . . , level q — f- The level of a cell can be increased 
by injecting charge into the cell, and decreased by removing 
charge from the cell. Flash memories have the prominent 
property that although it is relatively easy to increase a cell's 
level, it is very costly to decrease it. This follows from the 
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fact that flash-memory cells are organized as blocks, where 
every block has about 10^ '-^ 10^ cells. To decrease any 
cell's level, the whole block needs to be erased (which means 
to remove the charge from all the cells of the block) and 
then be reprogrammed. Block erasures not only are slow and 
energy consuming, but also significantly reduce the longevity 
of flash memories, because every block can endure only 
10^ ~ 10^ erasures with guaranteed quality [S). Therefore, it 
is highly desirable to minimize the number of block erasures. 
In addition to flash memories, other storage media often have 
their own distinct constraints for state transitions. Examples 
include magnetic recording ifTTll . optical recording fT[\, and 
phase-change memories 1221 . 

In general, the constraints of a memory on its state transi- 
tions can be described by a directed graph, where the vertices 
represent the memory states and the directed edges represent 
the feasible state transitions fS], Q. Different edges may have 
different costs [SI. Based on the constraints, an appropriate 
coding scheme is needed to represent the data so that the data 
can be rewritten efficiently. In this paper, we focus on flash 
memories, and our objective is to rewrite data as many times 
as possible between two block erasures. Note that between two 
block erasures, the cell levels can only increase. Therefore we 
use the following flash-memory model: 

Definition 1. (Flash-Memory Model) 

Consider n Hash-memory cells of q levels. The cells ' state can 

be described by a vector 

(ci,C2,...,c„) e {0,l,.-.,q-lV, 

where for i = 1,2, ... ,n, c, is the level of the i-th cell. The 
cells can transit from one state (ci, C2, ■ ■ ■ , Cn) to another state 
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. . . ,Cjj) if and only if for i = 1,2, ... , n, 
c'j ^ Cj for i = 1,2, . . . ,n, we say that {c[, Cj, . . - , 
(C1,C2, ...,c„).) 
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In this work, we focus on designing rewriting codes for 
general data-storage applications. How the stored data can 
change its value with each rewrite, which we call the rewriting 
model, depends on the data-storage application and the used 
data structure. Several more specific rewriting models have 
been studied in the past, including write-once memory (WOM) 
codes H, 13, Q, Col, m, EZl, floating codes Ig), HI, 
JBl . lfT9l . Il33l and bujfer codes 0, El. In WOM codes, 
with each rewrite, the data can change from any value to 
any other value. In floating codes, k variables Vi, V2, ■ ■ ■ ,Vj^ 
are stored, and every rewrite can change only one variable's 
value. The rewriting model of floating codes can be used in 
many applications where different data items can be updated 
individually, such as the data in the tables of databases, in 
variable sets of programs, in repeatedly edited files, etc. In 
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buffer codes, k data items are stored in a queue (namely, first- 
in-first-out), and every rewrite inserts a new data item into the 
queue and removes the oldest data item. 

All the above rewriting models can be generalized with 
the following graph model, which we call the generalized 
rewriting model. 

Definition 2. ( Generalized Rewriting Model) 

The stored data and the possible rewrites are represented by a 

directed graph 

V = {Vv,Ev). 

The vertices represent all the values that the data can take. 
There is a directed edge {u, v) from u & Vqy to v & Vjy (where 
V 7^ u) ii¥ a rewrite may change the stored data from value u to 
value V. The graph T) is called the data graph, and its number 
of vertices - which corresponds to the data's alphabet size - is 
denoted by 

L=\V'd\. 

(Throughout the paper we assume that the data graph is strongly 
connected.) □ 

Note that the data graph is a complete graph for WOM 
codes, a generalized hypercube for floating codes, and a de 
Bruijn graph for buffer codes. Some examples are shown in 
Fig.[T] With more data storage apphcations and data structures, 
the data graph can vary even further. This motivates us to study 
rewriting codes for the generalized rewriting model. 

A rewriting code for flash memories can be formally defined 
as follows. Note that in the flash-memory model, n cells of q 
levels are used. The definition below can be easily extended 
to other constrained memory models. 

Definition 3. (Rewriting Code) 

A rewriting code has a decoding function F^j and an update 
function F„ . The decoding function 

Fa:{0,l,...,q-l}"^Vv 

means that the cell state s E {0, 1, . . . ,q — 1}" represents the 
data Fii{s) E V-p. The update function (which represents a 
rewrite operation), 

f„ : {0,1,..., q-1}" xVv^ {0,l,...,q-l}\ 

means that if the current cell state is s E {0,1,. ..,q — 1}" and 
the rewrite changes the data tov E V-p, then the rewriting code 
changes the cell state to Fu{s,v). All the following must hold: 

1) {Fd{s),v) E Ev. 

2) The cell-state vector Fu (s, v) is above s. 

3) Fd{Fu{s,v)) = v. 

Note that if Fci{s) = v, we may set Fu{s,v) = s, which 
corresponds to the case where we do not need to change the 
stored data. Throughout the paper we do not consider such a 
case as a rewrite operation. □ 

A sequence of rewrites is a sequence {vq,Vi,V2 ■ ■ ■) such 
that the /-th rewrite changes the stored data from J7,_x to Vi. 
Given a rewriting code C, we denote by f(C) the maximal 
number of rewrites that C guarantees to support for all rewrite 
sequences. Thus, t[C) is a worst-case performance measure 



of the code. The code C is said to be optimal if t{C) is max- 
imized. In addition to this definition, if a probabilistic model 
for rewrite sequences is considered, the expected rewriting 
performance can be defined accordingly. 

In this paper, we study generalized rewriting for the flash- 
memory model. We present a novel rewriting code, called the 
trajectory code, which is provably asymptotically optimal (up 
to constant factors) for a very wide range of scenarios. The 
idea of the code is to trace the changes of data in the data 
graph T>. The trajectory code includes WOM codes, floating 
codes, and buffer codes as special cases. 

We also study randomized rewriting codes and design codes 
that are optimized for the expected rewriting performance 
(namely, the expected number of rewrites the code supports). 
A rewriting code is called robust if its expected rewriting per- 
formance is asymptotically optimal for all rewrite sequences. 
We present a randomized code construction that is robust. 

Both our codes for general rewriting and our robust code 
are optimal up to constant factors (factors independent of the 
problem parameters). Namely, for a constant r ^ 1, we present 
codes C for which t{C) is at least r times that of the optimal 
code. We would like to note that, for our robust code, the 
constant involved is arbitrarily close to 1. 

The rest of the paper is organized as follows. In Section Ull 
we review the related results on rewriting codes, and compare 
them to the results derived in this paper In Section Hill a 
new rewriting code for the generalized rewriting model, the 
trajectory code, is presented and its optimality is proved. In 
Section |lVl robust codes optimized for expected rewriting 
performance are presented. In Section [V] the concluding 
remarks are presented. 

II. Overview of Related Results 

There has been a history of distinguished theoretical study 
on constrained memories. It includes the original work by 
Kuznetsov and Tsybakov on coding for defective memo- 
ries ifTSll . Further developments on defective memories in- 
clude El, im. The write-once memory (WOM) 123, write- 
unidirectional memory (WUM) ||24| - ||261 . and write-efficient 
memory HI, [Sl, are also special instances of constrained 
memories. Among them, WOM is the most related to the flash- 
memory model studied in this paper 

Write-once memory (WOM) was studied by Rivest and 
Shamir in their original work 1231 . In a WOM, a cell's state 
can change from to 1 but not from 1 to 0. This model was 
later generalized with more cell states in IS), 17] . The objective 
of WOM codes is to maximize the number of times that the 
stored data can be rewritten. A number of very interesting 
WOM code constructions have been presented over the years, 
including the tabular codes, linear codes, and others in l23]| . 
the linear codes in Q, the codes constructed using projective 
geometries l20ll . and the coset coding in j41. Profound results 
on the capacity of WOM have been presented in Q, ITOl . 
EH, l27l . Furthermore, error-correcting WOM codes have 
been studied in l34l . In all the above works, the rewriting 
model assumes no constraints on the data, namely, the data 
graph P is a complete graph. 
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Figure 1. The data graph T> for different rewriting models, (a) The data graph V for a WOM code. Here the data has an alphabet of size 6. Since a rewrite 
can change the data from any value to any other value, I? is a complete graph, (b) The data graph V for a floating code. Here /c = 3 variables of alphabet 
size £ = 3 are stored. Since every rewrite can change exactly one variable's value, I? is a generalized hypercube of regular degree k[l — 1) = 6 (for both 
out-degree and in-degree) in /c = 3 dimensions, (c) The data graph I? for a buffer code. Here /c = 3 variables of alphabet size 1 = 2 are stored in a queue. 
Since every rewrite inserts a new variable into the queue and removes the oldest variable from the queue, I? is a de Bruijn graph of degree £ = 2. 



With the increasing importance of flash memories, the flash- 
memory model was proposed and studied recently in 121, 
ifTZI . ifTsl . The rewriting schemes include floating codes ifTSl - 
ifTSl and buffer codes JJ], |[T4l . Both types of codes use 
the joint coding of multiple variables for better rewriting 
capability. Their data graphs D are generalized hypercubes and 
de Bruijn graphs, respectively. Multiple floating codes have 
been presented, including the code constructions in |fT3l . ifTSl . 
the flash codes in ||T9l . Il33l . and the constructions based on 
Gray codes in IS). The floating codes in |6| were optimized for 
the expected rewriting performance. The study of WOM codes 
- with new applications to flash memories - is also continued, 
with a number of improved code constructions |fT6l . ||281 - ||3T| . 

Compared to existing codes, the codes in this paper not only 
work for a more general rewriting model, but also provide 
efficiently encodable and decodable asymptotically-optimal 
performance for a wider range of cases. This can be seen 
clearly from Table |I] where the asymptotically-optimal codes 
are summarized. We explain some of the parameters in Table U 
here. For the WOM code, a variable of alphabet size I is 
stored. For the floating code and the buffer code, k variables 
of alphabet size I are stored. For rewriting codes using the 
generalized rewriting model, L is the size of the data graph. 
For all the codes, n cells are used to store the data. It can be 
seen that this paper substantially expands the known results 
on rewriting codes. 



III. Trajectory Code 

We use the flash-memory model of Definition [T] and the 
generalized rewriting model of Definition [2] in the rest of this 
paper. We first present a novel code construction, the trajectory 
code, then show its performance is asymptotically optimal. 



A. Trajectory Code Outline 

Let hq, Hi, «2/ ■ . ■ he d + 1 positive integers and let 

d 

n = J2 rii, 

where n denotes the number of flash-memory cells, each of 
q levels. We partition the n cells into d + 1 groups, each 
with nQ,ni,. . cells, respectively. We call them registers 
So, Si, . . . , S^;, respectively. 

Our encoding uses the following basic scheme: we start by 
using register Sq, called the anchor, to record the value of the 
initial data Vq E V-p- 

For the next d rewrite operations we use a differential 
scheme: denote by Vi,...,v^ E V-p the next d values of the 
rewritten data. In the z-th rewrite, 1 ^ z d, we store in 
register S, the identity of the edge E E-p. We do not 

require a unique label for all edges globally, but rather require 
that locally, for each vertex in Vp, its out-going edges have 
unique labels from {1, . . . , A}, where A denotes the maximal 
out-degree in the data graph V. 

Intuitively, the first d rewrite operations are achieved by 
encoding the trajectory taken by the input sequence starting 
with the anchor data. After d such rewrites, we repeat the 
process by rewriting the next input from V75 in the anchor Sq, 
and then continuing with d edge labels in Si, ... ,5^. 

Let us assume a sequence of s rewrites have been stored 
thus far. To decode the last stored value, all we need to know 
is s mod {d + 1). This is easily achieved by using \t/q'\ 
more cells (not specified in the previous d + 1 registers), where 
t is the total number of rewrite operations we would like to 
guarantee. For these \t/ ql cells we employ a simple encoding 
scheme: in every rewrite operation we arbitrarily choose one 
of those cells and raise its level by one. Thus, the total level 
in these cells equals s. 

The decoding process takes the value of the anchor Sq 
and then follows (s — 1) mod + edges which are read 
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TABLE I 

A SUMMARY OF THE REWRITING CODES WITH AS YMPTOTICALLY OPTIMAL PERFORMANCE (UP TO CONSTANT FACTORS). HERE n,k,£,L ARE AS 

DEFINED IN SECTIOn|I]aND SECTIOn|II] 



Type 


Asymptotic optimality 


REF. 


WOM code (D is a complete graph) 


t{C) is asymptotically optimal 


(23) 


WOM code (D is a complete graph) 


t{C) is asymptotically optimal when £ = 0(1) 


(5J 


Floating code (D is a hypercube) 


t{C) is asymptotically optimal when k = 0(1) and £ = 0(1) 


[131 f.l5J 


Floating code (D is a hypercube) 


t(C) is asymptotically optimal when n = n(fclogfc) and £ = 0(1) 


I13J 115J 


Floating code (V is a hypercube) 


t{C) is asymptotically optimal when n = n(/c'^) and £ = 0(1) 


(33) 


Buffer code (D is a de Bruijn graph) 


t{C) is asymptotically optimal when n = n(k) and £ = 0(1) 


|2l (32) 


Floating code (D is a hypercube) 


codes designed for random rewriting sequences when fc = 0(1) and £ = 2 


(6) 


WOM code (D is a complete graph) 


t{C) is asymptotically optimal 


this paper 


Rewriting code for the generalized 
rewriting model (V has maximum out- 
degree A.) 


For any A, t(C) is asymptotically optimal when n = n(logL) 


this paper 


Robust coding 


Asymptotically optimal (with constant 1 — £) when nq = n(LlogL) 


this paper 



consecutively from Si,S2, .... Notice that this scheme is 
appealing in cases where the maximum out-degree of V is 
significantly lower than the size of the state space | V-p \ ■ 

Note that for i = 0,1, . . . ,d, each register S,- can be seen as 
a smaller rewriting code whose data graph is a complete graph 
of either L vertices (for Sq) or A vertices (for Si, . . . , S^). We 
let = if 25 is a complete graph, and describe how to set d 
when T) is not a complete graph in section UlI-CI The encoding 
used by each register is described in the next section. 

B. Analysis for a Complete Data Graph 

In this section we present an efficiently encodable and 
decodable code that enables us to store and rewrite symbols 
from an input alphabet of size L ^ 2, when I* is a 
complete graph. The information is stored in n flash-memory 
cells of q levels each. 

We first state a scheme that allows approximately nq/?> 
rewrites in the case in which 2 ^ L ^ n. We then extend it 
to hold for general L and n. We present the quality of our 
code constructions (namely the number of possible rewrites 
they perform) using asymptotic notation: O(-), n(-), 0(-)' 
o(-), and (where in all cases n is considered to be the 
asymptotic variable that tends to infinity). 

1) The case o/ 2 ^ L ^ n: In this section we present a 
code for small values of L. The code we present is essentially 
the one presented in |[23l. 

Construction 1. Let 2 ^ L ^ n. This construction produces 
an efficiently encodable and decodable rewriting code C for a 
complete data graph T> with L states, and flash memory with n 
cells with q levels each. 

Let us flrst assume n = L. Denote the n cell levels by c = 
(co, Ci, . . . , Cl-1 ) , where c, E {0,1, ... ,q — 1} is the level of 
the i-th cell for i = 0,1, . . . ,L — 1. Denote the alphabet of the 
data by = {0, 1, . . . ,L — 1}. We flrst use only cell levels 
and 1, and the data stored in the cells is 

L-l 

ici (mod L). 

1=0 

With each rewrite, we increase the minimum number of cell 
levels from to 1 so that the new cell state represents the new 



data. (Clearly, cq remains untouched as 0.) When the code can 
no longer support rewriting, we increase all cells (including cq) 
from to 1, and start using cell levels 1 and 2 to store data in 
the same way as above, except that the data stored in the cells 
uses the formula 

L-l 

i{ci — 1) (mod L). 

i=0 

This process is repeated q — 1 times in total. The general 
decoding function is therefore deflned as 

L-l 

frf(c) = E '('^i ~ "^o) (mod L). 

i=0 

We now extend the above code to n ^ L cells. We divide 
the n cells into b = [n/L\ groups of size L (some cells may 
remain unused). We flrst apply the code above to the flrst group 
ofL cells, then to the second group, and so on. □ 

Theorem 4. Let 2 ^ L ^ n. The number of rewrites the code 
C of Construction\l\guarantees is lower bounded by 

t{C) ^ n{q -l)/8 = n{nq). 

Proof: First assume n = L. When cell levels j — 1 and / 
are used to store data (for j = 1, . . . ,q — 1), hy the analysis 
in 1231 . even if only one or two cells increase their levels with 
each rewrite, at least (L + 4) /4 rewrites can be supported. So 
the L cells can support at least 

.(c)><i±iMti)^n,„,) 

rewrites. Now let n ^ L. When b = [n/LJ, it is easy to see 
that bL ^ n/2. The b groups of cells can guarantee 

rewrites. ■ 
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2) The Case of Large L: We now consider the setting 
in which L is larger than n. The rewriting code we present 
reduces the general case to that of the case n = L studied 
above. The majority of our analysis addresses the case in 
which n < L ^ 2"/^^. We start, however, by first considering 
the simple case in which 2"^^^ ^ ^ Notice that if L is 
greater than q" then we cannot guarantee even a single rewrite. 

Construction 2. Let c e [2'^^'^^,q], and let L = c". This 
construction produces an efficiently encodable and decodable 
rewriting code C for a complete data graph T> with L states, and 
Hash memory with n cells with q levels each. 

Denote the n cell levels by c = (cq, Cj, . . .,c„_i), where 
Ci e {0,1, . . . ,q — 1} is the level of the i-th cell for 
i = 0, 1, . . . , n — 1. Denote the alphabet of data by Vx> = 
{0,1,. . .,L — 1}. For the initial (re)write we use only cell 
levels to [c] — 1, and the data stored in the cells is 

"j^CilcX (modL). 

With the next rewrite, we use the cell levels |^c] to 2 |^c] — 1 
and the data stored in the cells is now 

!=0 

and so on. In general, 

= E(^/mod H) [c]' (modL). 
(=0 

and with each rewrite we represent v E V-p by its n-character 
representation over an alphabet of size \c\ . □ 

The following theorem is immediate. 

Theorems. Let c e [l^'^'',q\. If L = c" then the code C of 
Construction^guarantees t{C) ^ q/ [c] = n{q/c). 

We now address the case n < L ^ 2"/^^. Let b be the 
smallest positive integer value that satisfies 

[n/b]'' ^ L. 

Claim 6. Forn L 2"/!^, it holds that 

21ogL 



We used the fact that L ^ 2"^^^ to establish the inequality 



b sC 



log(«/logL)' 



Proof: Let b = -, — Notice that 

log (n/ log L) 

nlog {n/ logL) 



ln/b\ ^ 
Thus, 

log \ nlb^ = blog \ nlb\ 
21ogL 



41ogL 



log (n/ log L) 

21ogL 
log (n/ log L) 

21ogL 
log (n/ log L) 



log 



log 
log 



nlog logL) 
4 logL 



4 logL 



log I 



logL 



4IogL 



used in the last step above. 



Constructions. Let n < L ^ 2"^^^. This construction 
produces an efficiently encodable and decodable rewriting code 
C for a complete data graph V with L states, and flash memory 
with n cells with q levels each. 

For i = 1,2, . . .,b, let c, be a symbol from an alphabet of 
size 



l/h 



[n/b\ ^ L 



We may represent any symbol v E V-p as a vector of symbols 

{VI,V2,...,V^,). 

Partition the n flash-memory cells into b groups, each with 
\n/b\ cells (some cells may remain unused). Encoding the 
symbol v into n cells is equivalent to the encoding of each v, 
into the corresponding group of [n/b\ cells. As the alphabet 
size of each Vj equals the number of cells it is to be encoded 
into, we can use Construction\l\to store Vj. □ 

Example 7. Let n = 16, q = A, L = 56, and the data graph 
T) be a complete graph. We design a rewriting code for these 
parameters with the method of Construction^ 

Let b = 2, and we divide the n = 16 cells evenly into b = 2 
groups. Let c = {cq,Ci, . . . ,£7) denote the cell levels of the first 
cell group, and let c* = (cg, Cj, . . . , Cj) denote the cell levels of 
the second cell group. 

Let e {0, 1, L - 1} = {0, 1, 55} denote the value 
of the stored data. Let v\ and be two symbols of alphabet 
size 8. We can represent v by the pair {v\, Vj) as follows: 



vi = [v/8\ 



V2 = V mod 8. 



We store Vi in the first cell group using the decoding function 

7 

vi = J2i{Ci-Co) (mods), 

1=0 

and store V2 in the second cell group using the decoding 
function 

V2 = j^i{c\-c'o) (mods). 

Reconstructing v from {vi, f 2) is done byv = 8vi + V2. Thus, 
if the data, v, changes as 

^ 23 ^ 45 ^ 6 ^ 27 ^ 12, 

the symbol pair {vi, V2) will change as 

(0,0) ^ (2,7) ^ (5,5) ^ (0,6) ^ (3,3) ^ (1,4), 

and the cell levels (c, (?) = ((cq, Ci, . . . , cy), (cq, c[, . . .,c'y)) 
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will change as 

( (0, 0, 0, 0, 0, 0, 0, 0), (0, 0, 0, 0, 0, 0, 0, 0) ) 

; 

( (0, 0, 1, 0, 0, 0, 0, 0), (0, 0, 0, 0, 0, 0, 0, 1) ) 

; 

( (0, 0, 1, 1, 0, 0, 0, 0), (0, 0, 0, 0, 0, 0, 1, 1 ) ) 

; 

( (0, 0, 1, 1, 1, 0, 0, 1), (0, 1, 0, 0, 0, 0, 1, 1) ) 

; 

( (0, 0, 1, 1, \,\,\,\), (0, 1, 0, 0, 0, 1, 1, 1) ) 

; 

((1,2, 1, 1, 1, 1, 1, 1), (0, 1, 1, 1, 1, 1, 1, 1) ) 

A careful reader will have observed that the parameters here 
actually do not satisfy the condition n < L ^ 2"^^^. Indeed, the 
condition n < L ^ 2"/^^ is chosen only for the analysis of the 
asymptotic performance. The rewriting code of Construction^ 
can be used for more general parameter settings. □ 

Theorem 8. Let n ^ L ^ 2"/^^. The number of rewrites the 
code C of Construction^guarantees is lower bounded by 

^^^^ ^ «(t?-l)log(w/logL) ^^(nq log {n/ log L) 



16 log L \ logi- 

Proof: Using Construction |3] the number of rewrites 
possible is bounded by the number of rewrites possible for 
each of the h cell groups. By Theorem |4] and Claim |6] this is 
at least 

q-l ^ ( wlog(n/logL) .\a-l 



n 



21ogL 
«r?log(n/logL) 



logL 



C. Analysis for a Bounded-Out-Degree Data Graph 

We now return to the outline of the trajectory code from 
Section UlI-AI and apply it in full detail using the codes from 
Section lTlI-Bl to the case of data graphs T> with upper bounded 
out-degree A. We refer to such graphs as A-restricted. To 
simplify our presentation, in the theorems below we will again 
use the asymptotic notation freely; however, as opposed to the 
previous section we will no longer state or make an attempt to 
optimize the constants involved in our calculations. We assume 
that n ^ L, since for L ^ n. Construction [1] can be used to 
obtain optimal codes (up to constant factors). In this section 
we study the case L ^ 2"^^^. We do not address the case 
of larger L, as its analysis, although based on similar ideas, 
becomes rather tedious and overly lengthy. 

Using the notation of Section ITlI-AI to realize the trajectory 
code we need to specify the sizes n, and the value of d. We 
consider two cases: the case in which A is small compared to 
n, and the case in which A is large. 

The following construction is for the case in which A is 
small compared to n. 



Construction 4. Let 



nlog {n/ log L) 



We build an efficiently encodable and decodable rewriting code 
C for any A-restricted data graph V with L vertices and n flash- 
memory cells of q levels as follows. For the trajectory code, let 

d= LlogL/log(n/logL)J =0(logL/log(n/logL)). 

Set the size of the d-\-l registers to 



and 



no = \_n/2\ 



\n/{2d)\ ^ A 



for i = \,2, . . . ,d. (We obviously have Yli=Q ^ n.) 

The update and decoding functions of the trajectory code C 
are defined as follows. We use the encoding scheme specified 
in Construction [3] to store in the Uq cells of the register Sq an 
"anchor" (i.e., a vertex) ofD, which is a symbol in the alphabet 
Vv = {0,1,...,L-1}. 

For i = 1,2, ... ,d, we use the encoding scheme specified 
in Construction^ to store in the rij cells of the register S, an 
"edge" ofD, which is a symbol in the alphabet {0, 1, . . . , A — 
1}. Notice that the latter is possible because Ui ^ A for i = 
l,...d. □ 

Recall that the anchor and the edges stored in Sq, Si, S2, . . . 
show how the data changes its value with rewrites. That is, 
they show the trace of the changing data in the data graph V. 
Every d + 1 rewrites change the data stored in the register S, 
exactly once, for i = 0,1, . . .,d. After every + 1 rewrites, 
the next rewrite resets the anchor's value in Sq, and the same 
rewriting process starts again. 

Suppose that the rewrites change the stored data as Vq — > 
■ ■ ■ Vj — > Vj^i^i — )• ■ ■ ■ . Then with the rewriting 

code of Construction |4] the data stored in the register 
So changes as vq Vd+i ^2(d+l) ^ ^3(rf+l) ^ 
• • • . For i = 1,2, . . .,d, the data stored in the regis- 
ter Si changes as (z;,-„i, i;,-) (^,--i+(d+i)/^/+(rf+i)) ^ 

i'"i^l+2{d+iy^i+2{d+l)) (^/-l+3((f+l)''^(+3((f+l)) ^ ■■• 

Here every edge {vj^i,Vj) G is locally labeled by the 
alphabet {0, 1, . . . , A - 1}. 

Theorem 9. Let L ^ 2«/i6 ^^d A ^ [ "'°^2togL^^' J - The 
number of rewrites the code C of Construction^guarantees is 

t{C) = Cl{nq) 

Proof: By Theorems H] and |4] the lower bound on the 
number of rewrites possible in Sq is equal (up to constant 
factors) to that of S, (i ^ 1): 

j-j f wo?log(wo/logL) \ ^^f nqlog{n/logL) 



log I 



n 



logL 
= O (riiq) . 



nq 



Thus, the total number of rewrites in the scheme outlined in 
Section IIII-AI is lower bounded by d + 1 times the bound for 
each register S,-, and so t{C) = Ci{nq). ■ 



7 



Example 10. Consider floating codes, where k variables of 
alphabet size £ are stored in n cells of q levels. When Con- 
struction^is used to build the Boating code, we get L = £^ and 



A = k{e-i). soifk{e 

can guarantee t{C) 
optimal. 



1) ^ 



the code 



«log(n/(/:log(?)) 
_ 2k\og{ _ 

Ci{nq) rewrites, which is asymptotically 

□ 



The next construction is for the case in which A is large 
compared to n. 

Constructions. Let L ^ 2"/^'' and let 



n log (n/ log L) 



^ A ^ L 



We build an efficiently encodable and decodable rewriting code 
C for any A-restricted data graph V with L vertices and n flash- 
memory cells ofq levels as follows. For the trajectory code, let 

d= [log!/ log AJ = ©(log L/ log A). 

Set the size of the registers to 

no = ln/2\ 



and 



«,•= [n/{2d)\ 



fori = 1,1,..., d. 

The update and decoding functions of the trajectory code C 
are defined as follows: use the encoding scheme specified in 
Construction^ to store an "anchor" in Sq and store an "edge" 
in Si, for i = 1,2, ... ,d. (The remaining details are the same 
as Construction^) □ 

Theorem 11. Let L ^ 2"/i6_ ^^^f \ nlog(nnogL) ^ ^ ^ ^ 

L — 1. The number of rewrites the code C of Construction^ 
guarantees is lower bounded by 



t{C) = n 



nq log {n/ log L) 
log A 



Proof: By Theorem [8j the number of rewrites supported 
in So is lower bounded by 



n 



notjlog(wo/logL) 
log! 



nqlog{n/logL) 
logL 



Similarly, for i = 1,2, . . . ,d, the number of rewrites supported 
in S, is lower bounded by 



^ ,' w/tjlog(n,/logA) \ ^^f nqlog{n/logL] 



log A 



n 



dlog A 
nq log (w/ log L) 
logL 



Thus, as in Theorem |9] we conclude that the total number 
of rewrites in the scheme outlined in Section IIII-AI is lower 
bounded by d + 1 times the bound for each register S;, and 
so f(C) = Q(^lil5£|^' 



D. Optimality of the Code Constructions 

We now prove upper bounds on the number of rewrites 
in general rewriting schemes, which match the lower bounds 
induced by our code constructions. They show that our code 
constructions are asymptotically optimal. 

Theorem 12. Any rewriting code C that stores symbols from 
some data graph T> in n flash-memory cells ofq levels supports 
at most 

t{C) i^n{q-l) =0{nq) 

rewrites. 

Proof: The bound is trivial. In the best case, all cells are 
initialized at level 0, and every rewrite increases exactly one 
cell by exactly one level. Thus, the total number of rewrites 
is bounded by n{q — 1) = 0{nq) as claimed. ■ 

Corollary 13. The codes from Constructions [T] and |4] are 

asymptotically optimal. 

For large values of L, we can improve the upper bound. 
First, let r denote the largest integer such that 



r + n 



< L-1. 



We need the following technical claim. 

Claun 14. Let L 2"/l6_ For aii 1 ^ n < L - 1, the following 
inequality 

logL 

r ^ c- 

log(«/logL) 

holds for a sufficiently small constant c > 0. 

Proof: First, it is easy to see that r E [1, n]. Now we may 
use the well-known bound for all v > u ^ 1, 



/evy 



< 

u; 



where e is the base of the natural logarithm. Let m = n/r. It 
follows that, 

r-\-n-l\ ^ /r + n\ ^ /2n\ ^ 2''e''n'' 



Hence, 

log ^ j ^ r^og ^— j=- log{2em). 

Thus, it suffices to prove that 

^log(2£'m) <log(L-l). 

We conclude via basic computations that if 
, M log («/ logL) 



m 



log I 



for a sufficiently large constant c' > 0, then 

^r + n-l\ 
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Theorem 15. Let L ^ 2"^^^. When n < L — 1, any rewriting 
code C that stores symbols from the complete data graph V in 
n flash-memory cells ofq levels can guarantee at most 

' nq log {n/ log L)' 



logL 



rewrites. 



Proof: Let us examine some state s of the n flash-memory 
ceUs, currently storing some value v G Vx>, i.e., = v. 

Having no constraint on the data graph, the next symbol we 
want to store may be any of the L — 1 symbols v' G Vp, 
where v' ^ v. 

If we allow ourselves r operations of increasing a single cell 
level of the n flash-memory cells by one (perhaps operating 
on the same cell more than once), we may reach at most 

n + r — 1 
r 

distinct new states. However, by our choice of r, we have 
j-tt+r-l^i <; £ _ 1 So we need at least r + 1 such operations 
to reaUze a rewrite in the worst case. Since we have a total of 
n cells with q levels each, the guaranteed number of rewrite 
operations is upper bounded by 



t{C)^ 



n{q-l) 
r + 1 



O 



Mf?log(M/logL) 

logL 



CoroUary 16. The code from Construction^ is asymptotically 
optimal. 

Theorem 17. Let 2"/^'' ^L = c" f^q". Any rewriting code C 
that stores symbols from the complete data graph V inn flash- 
memory cells ofq levels can guarantee at most 

t{C) = Oiq/c) 

rewrites. 

Proof: We follow the proof of Theorem [15] In this case 
we note that for ("^^~^) to be at least of size L = c" we need 
r = Cl [nc). The proof follows. ■ 

Corollary 18. The code from Construction^ is asymptotically 
optimal. 

Theorem 19. Let L ^ 2"^'^^. Let A > 



n log (w/ logL) 
2TSp 



. There 

exist A-restricted data graphs T> over a vertex set of size L, 
such that any rewriting code C that stores symbols from the 
data graph T) in n flash-memory cells ofq levels can guarantee 
at most 

nqlog{n/ logL) 



log A 



rewrites. 



Proof: We start by showing that A-restricted graphs T> 
with certain properties do not allow rewriting codes C that 
support more than t{C) = O ^ ^ rewrites. We 
then show that such graphs indeed exist. This will conclude 
our proof. 

Let P be a A-restricted graph whose diameter d is at 
most O (l^l^y Assuming the existence of such a graph D, 



consider (by contradiction) a rewriting code C for the A- 
restricted graph T> that allows 



t{C) 



CO 



nq log {n/ logL) 
log A 



rewrites. We use C to construct a rewriting code C for a new 
data graph V which has the same vertex set V-pr = Vy but 
is a complete graph. The code C will allow 



t{C') 



CO 



nqlog{n/ logL) 
logL 



rewrites, a contradiction to Theorem [15] This will imply that 
our initial assumption regarding the quality of our rewriting 
code C is false. 

The rewriting code C' (defined by the decoding function F'^ 
and the update function F„) is constructed by mimicking C 
(defined by the decoding function and the update function 
Fj,). We start by setting F'^ = F^j. Next, let s be some state of 
the flash cells. Denote Frf(s) = F^(s) = vq & Vp. Consider 
a rewrite operation attempting to store a new value Vi E Vp, 
where Vi ^ Vq. There exists a path in V of length d' , where 
d' ^ d, from vq to Vi, which we denote by 

Vo,Ui,U2,...,U^,^l,Vi. 

We now define 

F'„{s,vi) = F„(F„(. ..Fu{Fu{s,ui),U2) . ■ ■ ,u^,_i),vi), 

which simply states that to encode a new value Vi we follow 
the steps taken by the code C on a short path from Vq to Vi 
in the data graph T>. 

As C guarantees t{C) = co ^ "l^og^if'^/logL) ^ j-gwrites, the 

code for C guarantees at least 



t{C') 



CO 



nq log {n/ logL) 
dlog A 



CO 



nq login/ logL) 



logL 



rewrites. Here we use the fact that d = O 



logL 
log A 



What is left is to show the existence of data graphs T) 
of maximum out-degree A whose diameter d is at most 



O 



logL 
log A 



To obtain such a graph, one may simply take a 



rooted bi-directed tree of total degree A and corresponding 
depth O 

Corollary 20. For L ^ 2"^^^, the code from Construction\5\is 
asymptotically optimal. 



IV. Robust Rewriting Codes 

It addition to the worst-case rewriting performance, it is 
also interesting to design rewriting codes with good expected 
performance. In this section we consider the use of randomized 
codes to obtain good expected performance for all rewrite 
sequences. 

Let V = ^2/ 5^3/ ■ • ■ / denote a sequence of 

rewrites. That is, for i = 1,2,3, . . ■ ,n{q — 1), the z-th rewrite 
changes the data to the value Vi G {0,1,..., L — 1}. By 
default, the original value of the data is Vq = 0, and since 
every rewrite changes the data, we require that for all i ^ 1, 
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Vi 7^ C'j-i- Also, as no more than n{q — 1) rewrites may be 
supported, the sequence v is limited to n{q — 1) elements. 

Let C denote a rewriting code, which stores the data from an 
alphabet of size L in n cells of q levels. The code C can only 
support a finite number of rewrites in the rewrite sequence v. 
We use t{C\v) to denote the number of rewrites in the rewrite 
sequence v that are supported by the code C. That is, if the 
code C can support the rewrites Vi,V2,-.-, up to Vj^, then 
t{C\v) =k. 

Let V denote the set of all possible rewrite sequences. If 
we are interested in the number of rewrites that a code C 
guarantees in the worst case, t{C), then we can see that 

t{C) = mint{C\v). 

In this section, we are interested in the expected number of 
rewrites that a code C can support under random coding. Let 
Q be some distribution over rewriting codes and let Cq be a 
randomized code (namely, a random variable) with distribution 
Q. Let E(x) denote the expected value of a random variable 
X. We define the expected performance of the randomized 
rewriting code Cq to be 

Ecq =miriE(f(CQ|u)). 

^ vev 

Our objective is to maximize E^^. Namely, to construct a 
distribution Q such that for all v, Cq will allow many rewrites 
in expectation. A code Cq whose E^^ is asymptotically 
optimal is called a robust code. For any constant £ > 0, 
in this section we will present a randomized code with 
E^ ^ (1 ~ ^)('? ~ (clearly, the code is robust). 



A. Code Construction 

We first present our code construction, analyze its properties 
and define some useful terms. We then turn to show that it is 
indeed robust. 

Let (ci,Ci, . ..,€„) denote the n cell levels, where for i = 
1,2, ... ,n, Ci e {0, 1, . . . , — 1} is the i-th cell's level. Given 
a cell state c = {c\,C2, . . . ,Cn), we define its weight, denoted 
by w{c), as 

n 

He) = E '^i- 
;=1 

Clearly, ^ iv{c) ^ [q — l)n. Given the decoding function, 
: {0,1,..., q-l}" {0,1,..., L- 1}, of a rewriting 
code, the cell state c represents the data F^{c). 

Construction 6. For all i = 0,1, ... ,n{q — 1) — 1 and j = 
l,2,...,n, let 6j j and a, be parameters chosen from the set 
{0,1,..., L-1}. 

We define a rewriting code C as follows. Its decoding func- 
tion is 



FJc) 



w{c)-l \ 



By default, ifc = (0, 0, . . . , 0), then Frf(c) = 0. When rewrit- 
ing the data, we take a greedy approach: For every rewrite, 
minimize the increase of the cell state's weight. (If there is a tie 



between cell states of the same weight, break the tie arbitrarily.) 

□ 

For simplicity, we will omit the term "mod L" in all com- 
putations below that consist of values of data. For example, 
the expression for in the above code construction will be 
simply written as 

n zv(c)-l 
(=1 1=0 

and F(f(c) — F(j(c') will mean (Fd(c) — Fd(c')) mod L. 

Definition 21. (Update Vector and Update Diversity) 

Let c = {ci, C2, ■ . . , Cn) be a cell state where for i = 1,2, . . . ,n, 

Ci e {0,1, ... ,q — 2}. For i = 1,2, . . . ,n, we define Ni{c) as 

Ni{c) = (Ci, . . . , C,_i, Ci + 1, c,-+i, ...,Cn) 

and define ei{c) as 

ei{c}=F,{N,i^)-F,{c). 
We also define the update vector ofc, denoted by u{c), as 

u{c) = {ei{c),e2{c),...,e„{c)), 
and the update diversity ofc as 

\{ei{c),e2{c),...,en{c)}\ . 

□ 

The update diversity of a cell state c is at most L. If it is L, 
it means that when the current cell state is c, no matter what 
the next rewrite is, we only need to increase one cell's level 
by one to realize the rewrite. Specifically, if the next rewrite 
changes the data from Ff;(c) to v', we will change from c to 
Ni{c) by increasing the f-th cell's level by one such that 

e.(c) = v' -Fctic). 

For good rewriting performance, it is beneficial to make the 
update diversity of cell states large. 

Lemma 22. Let c = (cj, C2, . . . , Cn) be a cell state where for 
i = 1,2, ... ,n, Ci e {0,1, ... ,q — 2}. With the rewriting code 
of Construction^ the update diversity ofc is 

\{Sw{c),i I i = 1/2 «} ■ 

Proof: For z = 1, 2, . . . , n, we have 

eK?) =Frf(M-(?))-Frf(c) 

n w[c) 

= E ^io(c),fj + ^w(c),i + E ^; 
j=l j=0 

n w(c)-l 

~Yl,^i''[c)-i,fi~ E 

j=l j=0 
n 

Only the first term, ^lyfj") depends on i. Hence the update 
diversity of c is 



1.2 n}| = |{ 



"w{c),i 



12,. ..,n} 
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Therefore, to make the update diversity of cell states large, 
we can make i, 6zi,(^^ 2' - ■ ■' ^w{c) n ^^^^ many different 
values as possible. A simple solution is to let 6ii,(^c),i — ' 
f = l,2,...,«. 

B. Robustness 

In the following, we present our code for n ^ L. (The 
case of smaller n can be dealt with using Construction |3]) 
The code uses randomness in the code construction to combat 
adversarial rewrite sequences. We then analyze the asymptotic 
optimality of the code for nq ^ LlogL, and show that it 
optimizes the constant in the asymptotic performance to 1 — e. 

For i = 1,2, ... ,L, we define 

gi = {; I 1 =^ ; =^ n,i = i (mod L)} . 

For example, if n = 8, L = 3, then gi = {1,4, 7}, ^2 = 
{2,5,8}, ^3 = {3,6}. For/ = 1,2,. ..,L, |^,| is either [n/L\ 
or [n/L] . We define 

= E 

where Cy is the ;-th cell's level. For i = 1,2, ... ,L, we have 

hre{0,l \gi\{q-l)}. 

We consider gi as a super cell whose level is hj. 

Construction 7. (Robust Code) 

For i = Q,l, ... ,n[q — 1) — 1, choose the parame- 
ter ai independently and uniformly randomly from the set 
{0,1,...,L-1}. 

We define a randomized rewriting code Cq by its decoding 
function 

1=1 1=0 

By default, if c = (0,0,..., 0), then Frf(c) = 0. When 
rewriting the data, we take the same greedy approach as in 
Construction^ □ 

When we consider gi,g2, ■ ■ ■ rgi L "super cells" whose 
levels are d = {hi,h2, . . ■,hi), we have 

n L 

^(c) = J2'^i = J2 = ^('^')- 

1=1 /=1 

The code of Construction [7] may be seen as a rewriting code 
that stores the data of alphabet size L in L super cells, whose 
decoding function is ([T]i. Each of the super cells has either 
{q - 1) [n/Lj + 1 levels or {q - 1) \n/L] + 1 levels. 

Lemma 23. Let c' = {hi,h2, . ■ . ,hi) be a super-cell state 
where for i = 1,2, ... ,L, hi {q - 1) [n/ L\ - 1. With the 
rewriting code of Construction^ the update vector of the super- 
cell state c' is 

u(c') = (l + a ,-,,,2 + fl .,L + fl ri\] ' 

^ ' \ zv{c') w(c') w(c'j j 

and the update diversity of the super-cell state d is L. 



Proof: For z = 1,2, . . .,L, N,(c') = (/zi, . ..,hi^i,hi + 
l,hi+i,...,hi), so 

eK?) = F,{Ni{d)) - F,{d) = i + a^^^^,^ 

and we get the conclusions. ■ 
Therefore, if the current super-cell state is c' = 
{hi,}i2, ■ . . ,hi) where for i = 1,2, ...,L, hi ^ {q — 
1) [n/L\ — 1, for the next rewrite, we only need to increase 
one super-cell's level by one (which is equivalent to increasing 
one flash-memory cell's level by one). 

Lemma 24. Let d = {hi,h2, . . . ,hi) be a super-cell state 
where for i = 1,2, ... ,L, hj {q - 1) [n/ L\ - 1. With the 
rewriting code of Construction^ if d is the current super-cell 
state, then no matter which value the next rewrite changes the 
data to, the next rewrite will only increase one super cell 's level 
by one, and this super cell is uniformly randomly selected from 
the L super cells. What is more, the selection of this super cell 
is independent of the past rewriting history (that is, independent 
of the super cells whose levels were chosen to increase for the 
previous rewrites). 

Proof: Let d be the current super-cell state, and assume 
the next rewrite changes the data to v'. By Lemma |23] we 
will realize the rewrite by increasing the i-th super cell's 
level by one such that / + flj^^pj = v' — F^{d). Since the 
parameter ^i^^f^^,-^ is uniformly randomly chosen from the set 
{0, 1, . . . , L — 1}, i has a uniform random distribution over 
{1,2,. ..,L}. 

The same analysis holds for the previous rewrites. Note that 
with every rewrite, the weight of the super cells, zv{c'), in- 
creases. Since aQ,ai, . . . , a„(^_x)_i are i.i.d. random variables, 
the selection of the super cell for this rewrite is independent 
of the selection for the previous rewrites. ■ 

The above lemma holds for every rewrite sequence. We now 
prove that the randomized rewriting code of Construction |7] is 
robust. 

Theorem 25. Let Cq be the randomized rewriting code of Con- 
struction^ Let V = (vi, V2, 1^3, ... ) be any rewrite sequence. 
For any constant e > there exists a constant c = c(e) > 
such that if nq ^ cL log L, then 

E{tiCQ\v));?{l-e)n{q-l), 

and therefore Cq is a robust code. 

Proof: Consider L bins such that the f-th bin can hold 
[q — 1) |^/| balls. We use hj to denote the number of balls 
in the z-th bin. Note that every bin can contain at least 
{q -1) ■ ['{\ balls and at most {q - 1) ■ ] balls. By 
Lemma l24l before any bin is full, every rewrite throws a ball 
uniformly at random into one of the L bins, independently 
of other rewrites. The rewriting process can always continue 
before any bin becomes full. Thus, the number of rewrites 
supported by the code Cq is at least the number of balls thrown 
to make at least one bin full. 

Suppose that n{q — 1) — (x^fnq balls are independently and 
uniformly at random thrown into L bins, and there is no limit 
on the capacity of any bin. Here, we set a to be c^h log L 
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for a sufficiently large constant c. For i = 1,2, ...,L, let x, 
denote the number of balls thrown into the z'-th bin. Clearly, 



E(x,-) = 
By the Chernoff bound. 



n{q-l) 



Pr 



By the union bound, the probability that one or more of 
the L bins contain at least {q — 1) ■ [^J balls is therefore 
upper bounded by Le^'^^* By our setting of a. we have 

Therefore, when n{q — 1) — a^Jnq balls are independently 
and uniformly at random thrown into L bins, with high 
probabiUty, all the L bins have [q — 1) ■ [^J — 1 or fewer 
balls. This suffices to conclude our assertion. Notice that our 
proof implies that with high probability (over Q) the value 
of t{CQ\v) will be large. This stronger statement implies the 
asserted one in which we consider E{t(CQ\v)). ■ 

V. Concluding Remarks 

In this paper, we presented a flexible rewriting model that 
generalizes known rewriting models, including those used 
by WOM codes, floating codes and buffer codes. We pre- 
sented a novel code construction, the trajectory code, for 
this generalized rewriting model and proved that the code is 
asymptotically optimal for a very wide range of parameter 
settings, where the performance is measured by the number 
of rewrites supported by flash-memory cells in the worst case. 
We also studied the expected performance of rewriting codes, 
and presented a randomized robust code. It will be interesting 
to apply these new coding techniques to wider constrained- 
memory applications, and combine rewriting codes with error 
correction. These remain as our future research topics. 
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